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DETAILED ACTION 

Response to Amendment 

1 . Applicants have submitted an Amendment, filed 7/26/07, without amending claims, and 
arguing to traverse claim rejections. Claims 1-5, 7-12, 14, 16, 18 and 20 are pending in the 
application. 

Response to Arguments 

2. Applicant's arguments (Remarks, pp. 2-4) filed 7/26/07 have been fully considered but 
they are not persuasive, because: 

In response to applicant's argument that Davis is nonanalogous art (Remarks, p. 2, 11. 4- 
10), it has been held that a prior art reference must either be in the field of applicant's endeavor 
or, if not, then be reasonably pertinent to the particular problem with which the applicant was 
concerned, in order to be relied upon as a basis for rejection of the claimed invention. See In re 
Oetiker, 977 F.2d 1443, 24 USPQ2d 1443 (Fed. Cir. 1992). In this case, regarding Applicant's 
remarks that Applicant's claimed invention is generally directed to providing a user with speech 
input guidance for commanding the operation of a device, whereas Davis is simply providing 
navigation instructions to a driver, the examiner contends that since Davis teaches detecting an 
audio or image output of an operated device along with outputting speech to the user, Davis 
constitutes analogous art. 

Applicant submits that Van Kleeck does not describe preventing speech guidance as 
recited in Applicant's claim 5, nor providing guidance with a screen or a confirmation soimd 
.when speech input guidance is prevented (Remarks, p. 2, 11. 1 1-20). However, the previous 
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Office Action on page 7 (dated ^I21IQ1\ relies on Davis, not Van Kleeck, to teach detecting 
whether an audio or image output of an operated device is occurring; and providing the user with 
the searched speech input guidance if it would not interfere with an audio or image output of an 
operated device, but not providing the user with the searched speech input guidance if it would 
interfere with an audio or image output of an operated device (col. 22, line 56 - col. 23, line 5, 
teaches "Back Seat Driver... integrated into the car's audio system... it should pay attention to 
what the driver is listening to [detecting audio output occurring] ... If the driver is listening to the 
radio, or playing a CD... the program should try to speak [provide guidance] less often, on the 
grounds that the driver has implicitly indicated a preference for what to listen 
to... suppress... notes altogether"; Abstract), as discussed in the previous Office Action on pp. 7 
and 9 (dated 4/27/07). 

In response to applicant's arguments against the references individually, one cannot show 
nonobviousness by attacking references individually where the rejections are based on 
combinations of references. See In re Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981); In re 
Merck & Co,, 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). 

With respect to arguments for claim 10, (Remarks, p. 2, 11. 21-24), Applicant's arguments 
fail to comply with 37 CFR 1 .1 1 1(b) because they amount to a general allegation that the claims 
define a patentable invention without specifically pointing out how the language of the claims 
patentably distinguishes them from the references. Further, as discussed in the previous Office 
Action on pp. 8-9 (dated 4/27/07), Davis in col. 22, line 56 - col. 23, line 5, which teaches "Back 
Seat Driver. . .integrated. into the car's audio system. . .it should pay attention to what the driver is 
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listening to [e.g. radio, route guidance]... suppress... When it must speak, it should borrow the 
audio channel rather than trying to speak over it." 

In response to applicant's argument that Au is nonanalogous art (Remarks, p. 2, line 25 - 
p. 3, line 14), it has been held that a prior art reference must either be in the field of applicant's 
endeavor or, if not, then be reasonably pertinent to the particular problem with which the 
applicant was concerned, in order to be relied upon as a basis for rejection of the claimed 
invention. See In re Oetiker, 977 F.2d 1443, 24 USPQ2d 1443 (Fed. Cir. 1992). In this case, Au 
teaches topological methods to organize semantic network data flows for conversational 
applications, which is in the same field of endeavor as Applicant's invention, a speech input 
guidance device, which involves dialog between the user and the system. 

Lastly, Applicant submits that Feldes does not count outputs for the individual speech 
input executing commands. However, Cohen, not Feldes, was relied upon in the previous Office 
Action (4/27/07) on p. 10 to teach this feature. Feldes was relied upon to teach providing a 
guidance output of the command in a different form firom that of the other commands when the 
count for a speech input executing command is in a form different from that of the other 
commands. Applicant submit that Feldes does not provide a branch option in a different form. 
The examiner respectfully disagrees. As indicated in the previous Office Action (4/27/07), 
Feldes teaches reading the options in groups (different form), to make it easier for the user to 
remember the options, and thereby reduce user frustration (paragraph 33)., The examiner 
maintains that this reads on providing a guidance output of a command in a different form. 

In response to applicant's arguments against the references individually, one cannot show 
nonobviousness by attacking references individually where the rejections are based on 
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combinations of references. See In re Keller, 642 F.2cl 413, 208 USPQ 871 (CCPA 1981); In re 
Merck & Co,, 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). Thus, the rejections made under 
35 U.S.C. 103 are maintained, and repeated, below. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 14 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Van 
Kleeck etal ("Van Kleeck"), US Patent 5,890,122 in view of Au, US Patent 6,778,970. 

Regarding claim 14 . Van Kleeck teaches a speech input guidance device comprising: a 
speech input guidance data accxmiulating (509) unit for recording speech input executing 
commands (a table of available commands are stored in the input facility and so inherently 
would have been recorded to be stored in said location) categorized by operation object 
(computer instructions are the device operations while the particular application program 
constitutes operation object; col. 3, 11. 29-32 and col. 4, 11. 10-23); 

a speech input guidance output request detecting unit (502) for detecting a speech input 
guidance output request from a user (the user activating the facility with an application program 
constitutes a request for speech guidance output); a data searching unit (502) for searching for 
and providing data (the process of displaying available commands would inherently require the 
processor to search the computer memory for available commands corresponding to the 
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particular application program being utilized) in said speech input guidance data accumulating 
unit according to an output from said speech input guidance output request detecting unit; and a 
speech input guidance output irnit (speech synthesizer; display) for providing speech input 
executing commands searched by said data searching unit as one of by a display screen and by 
speech (col. 4, 11. 10-23 and 11. 34-44 and col. 7, 11. 44-48); 

wherein said speech input guidance data accumulating unit (509) records (a hierarchy 
table of available commands for each application is stored in the input facility and so inherently 
would have been recorded to be stored in said location) speech input executing commands for 
indicating an operation object (card node) and commands for a speech input for indicating the 
content of an operation (children nodes) applied to the operation object and when said speech 
input guidance output request detecting unit (502) detects (spoken command is recognized) that a 
user enters only one of said speech input executing command for indicating an operation object 
and said speech input executing command for indicating an operation content, said data 
searching imit (502) searches for and provides (the interface searches for and displays all of the 
children nodes corresponding to the recognized command as the new list of active words) either 
a speech input executing command for indicating an operation object corresponding to an 
operation content entered by the user, or a speech input executing command for indicating an 
operation content corresponding to an operation object entered by the user (col. 5, 11. 10-24 and 
col. 6, 11. 6-63). 

Van Kleeck does not explicitly teach both possibilities of: said data searching unit 
searches for and provides a speech input executing command for indicating an operation object 
corresponding to an operation content entered by the user when only an operation content is 
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entered by the user without indicating and operation object and provides a speech input 
executing command for indicating an operation content corresponding to an operation object 
entered by the user when only an operation object is entered by the user without indicating an 
operation content. However, this feature would have been obvious given the teaching elements 
of Au, which teaches topological methods to organize semantic network data flows for 
conversational applications. Au teaches that all human language grammars are composed from 
objects, subjects and verbs; most languages have SVO [subject-verb-object] or SOV [subject- 
object-verb] order (col. 56, 11. 32-45), suggesting receiving keywords in different order. 

Therefore, it would have been obvious for one of ordinary skill in the art at the time the 
invention was made to modify the teaching elements of Van Kleeck with Au to include 
providing a speech input executing command for indicating an operation content [e.g. volume, 
temperature] corresponding to an operation object [e.g., up, down] entered by the user when only 
an operation object [e.g. up, down (verbs)] is entered by the user without indicating an operation 
content [e.g. volume, temperature (objects)] in order to facilitate languages which have SVO 
[subject-verb-object] order. The dictionary may be used for languages with various object, 
subject and verb ordering by changing the ordering rule used by the parser, as described by Au in 
col. 58, 11. 37-40. 

Regarding claim 20, Van Kleeck teaches a speech input guidance device comprising: a 
speech input executing command indicating means for specifying one of the speech input 
executing commands (active words) provided on the screen from said speech input guidance 
output unit (505; col. 4, 11. 63-66); and 
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a device operation means for conducting an operation (keystroke commands) specified by 
said speech input executing command indicating means (col. 4, line 66 through col. 5, line 7). 

5. Claims L 5 and 7-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Van 
Kleeck et al ("Kleeck"), US Patent 5,890,122 in view of Davis etal ("Davis"), US Patent 
5,177,685. 

Regarding claim K Van Kleeck teaches: detecting a device operation by a user (the 
process of activating the facility would inherently require the computer to detect keystrokes or 
mouse clicks; col. 4, 11. 24-25); and searching (the process of displaying available commands 
would inherently require the processor to search the computer memory for available commands 
corresponding to the particular application program being utilized) for a speech input executing 
command (available commands) corresponding to the device operation from a speech input 
guidance data accumulating xmit (504). 

Van Kleeck does not, but Davis suggests detecting whether an audio or image output of 
an operated device is occurring; and providing the user with the searched speech input guidance 
if it would not interfere with an audio or image output of an operated device, but not providing 
the user with the searched speech input guidance if it would interfere with an audio or image 
output of an operated device (col. 22, line 56 - col. 23, line 5, teaches "Back Seat Driver... 
integrated into the car's audio system... it should pay attention to what the driver is listening to 
[detecting audio output occurring] ... If the driver is listening to the radio, or playing a CD. . .the 
program should try to speak [provide guidance] less often, on the grounds that the driver has 
implicitly indicated a preference for what to listen to. . .suppress. . .notes altogether"; Abstract). 
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Therefore, it would have been obvious for one of ordinary skill in the art at the time the 
invention was made to modify the teaching elements of Van Kleeck with Davis because Davis 
teaches that the user may be implicitly indicating his/her preference for what to listen to (col. 22, 
11. 59-63), so giving priority to the audio output already occurring would allow the user to enjoy 
the music/audio output without interruption, and at the same time avoid confusing the user with 
simultaneous prompts and music. 

Regarding claim 5 , Van Kleeck teaches: a device operation detecting unit for detecting a 
device operation by a user (col. 4, 11. 10-15 and 11. 24-25); 

a speech input guidance data accumulating unit (509) for recording speech input guidance 
data (a table of available commands are stored in the input facility and so inherently would have 
been recorded to be stored in said location) for guiding the user to a command to be executed by 
means of speech for device operations categorized by device operation type (computer 
instructions are the device operations while the particular application program constitutes 
operation type; col. 3, 11. 29-32 and col. 4, 11. 10-23); and 

a data searching imit (502) for searching for (the process of displaying available 
commands would inherently require the processor to search the computer memory for available 
commands corresponding to the particular application program being utilized), and providing 
(displaying) speech input guidance data corresponding to, the device operation detected by said 
device operation detecting unit from said speech input guidance data accumulating imit; and a 
speech input guidance output unit (505) for providing the user with data searched by said data 
searching unit (col. 4, 11. 10-23 and 11. 34-44). 
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The remaining limitations of claim 5 are similar to that of claim 1, above, and is rejection 
for the same rationale. 

Regarding claims 7, 8 and 10 , Van Kleeck fails to disclose a speech input guidance 
controlling unit for stopping/preventing the speech input guidance when the operation of a 
device (e.g. device for providing audio output, a radio, route guidance by speech of a navigation 
device) is detected. However, this feature would have been obvious given the teaching elements 
of Davis in col. 22, line 56 - coL 23, line 5, which teaches "Back Seat Driver... integrated into 
the car's audio system. . .it should pay attention to what the driver is listening to [e.g. radio, route 
guidance] . . .suppress. . . When it must speak, it should borrow the audio channel rather than trying 
to speak over it." 

Therefore, it would have been obvious for one of ordinary skill in the art at the time the 
invention was made to modify the teaching elements of Van Kleeck with Davis because Davis 
teaches that the user may be implicitly indicating his/her preference for what to listen to (col. 22, 
11. 59-63), so giving priority to the output already occurring would allow the user to enjoy or 
focus on the current operation without interruption, and avoid confusing the user with 
simultaneous prompts and music. 

Regarding claim 9 , Van Kleeck teaches wherein at least one of guidance with a screen 
and a confirmation sound for indicating that a speech input is available is provided when the 
speech input guidance is stopped/prevented (the guidance data is provided to a screen display 
when made available and also goes into a wait state; col. 4, 11. 34-40 teaches, "the interface 
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program displays in an active words window a list of active words that the user may speak in 
order to input currently appropriate choices" and col. 4, line 57 through col. 5, line 9, teaches 
"the user speaks a word into the microphone, the interface program receives a digitized 
representation of the spoken word from the sound input module. . . The interface program then 
commimicates the choice associated with the recognized word to the application program. In a 
preferred embodiment, the interface program accomplishes this by submitting keystroke 
commands corresponding to the choice associated with the recognized word to the application 
program [for example, a stop command]. When the application receives these keystrokes, it acts 
upon the choice to which the keystrokes correspond. The interface program then updates the list 
of active words in light of the new currently appropriate choices [guidance with a screen for 
indicating that a speech input is available] and waits for the user to speak another word"). 

6. Claims 11-12 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over Van Kleeck 
in view of Davis, and further in view of Cohen et ai. US Patent.No. 6,560,576. 

Regarding claims 11-12 . Van Kleeck and Davis fail to teach recording a count of the 
outputs. However, Cohen teaches a data recording unit for recording counts of the guidance 
speech outputs (played prompts) and of the guidance screen display outputs (prompts) separately 
(Examiner takes the position that recorded counts would be made separate since the data 
correlates to two different interfaces) characterized by the device operation type (prompt specific 
conditions) from said speech input guidance unit (23) into the speech input guidance data 
accumulating unit (22), wherein said speech input guidance controlling unit (21) uses the data 
searching imit to search for/receive a count of outputs corresponding to a device operation, and 
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stops the speech input guidance when said count of outputs exceeds a predetermined number 
(Fig. 2; col. 9, 11. 8-17). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
applicant's invention to supplement Van Kleeck's and Davis' speech input guidance device with 
Cohen's recording output counts. The motivation for doing so would have been to allow 
experienced users benefit from learning to use a system more efficiently by eliminating the 
superfluous repeating of prompts as taught by Cohen (col. 6, 11. 8-10). 

7. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over Van Kleeck, 
Davis , and Cohen et al in view of Feldes et al. US Patent App. Pub. 2003/0091 1 76. 

Regarding claim 18, Van Kleeck teaches a speech input guidance data accumulating unit 
(509) for recording speech input executing commands (a table of available commands are stored 
in the input facility and so inherently would have been recorded to be stored in said location) 
characterized by operation object (computer instructions are the device operations while the 
particular application program constitutes operation object; col. 3, 11. 29-32 and col. 4, 11. 10-23); 

a speech input guidance output request detecting unit (502) for detecting a speech input 
guidance output request from a user (the user activating the facility with an application program 
constitutes a request for speech guidance output); 

a data searching unit (502) for searching for and providing data (the process of displaying 
available commands would inherently require the processor to search the compiuter memory for 
available commands corresponding to the particular application program being utilized) in said 
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speech input guidance data accumulating unit according to an output from said speech input 
guidance output request detecting unit; and 

a speech input guidance output unit (speech synthesizer; display) for providing speech 
input executing commands searched by said data searching unit as one of by a display screen and 
by speech (col. 4, 11. 10-23 and 11. 34-44 and col. 7, 11. 44-48). 

Van Kleeck, Davis, and Cohen do not explicitly teach the speech input guidance output 
unit provides a guidance output of the command in a form different from that of the other 
commands when the count for a speech input executing command is more than a predetermined 
number. However, Feldes et al teaches, "Commands and control information can be input by 
the user via the telephone in spoken form" (paragraph 12), "provide a communication 
system. . .permit a customer an acoustic. . .spoken access. . .provides graphic and/or textual 
information" (abstract), "text content of the start page can, so to speak, be 'read' to the user via a 
telephone. . .Should the number of branch options exceed a predetermined limit value, dialog 
control device can ensure that the branch options are read' to the user in groups [different form], 
it being easier for the user to remember the branch options in this manner" (paragraph 33). 

Therefore, it would have been obvious for one of ordinary skill in the art at the time the 
invention was made to record counts of outputs from said speech input guidance unit for the 
individual speech input executing commands, and if said count for a speech input executing 
command is more than a predetermined number, the speech input guidance unit provides a 
guidance output of that command in a form different from that of the other commands, because 
Feldes et al teaches when there are too many options, there are better ways to assist the user. 
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such as reading the options in groups (different form), to make it easier for the user to remember 
the options, and thereby reduce user frustration (paragraph 33). 

The rest of the Hmitations of claim 18 are the same as or similar to those of claim 1 1, 
rejected above, and thus are rejected for the same reasons. 

8. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over Van Kleeck and 
Au in view of White, US Patent No. 5,386,494. 

Van Kleeck teaches recording speech input executing commands into a speech input 
guidance data accumulating unit, but fails to disclose of providing paraphrased speech input 
executing commands. Van Kleeck and Au do not, however White teaches recording speech 
input executing commands for paraphrasing the individual speech input executing commands, 
and the speech input guidance output unit provides paraphrasing speech input executing 
commands corresponding (associated) to an entered speech input executing command (Fig. 5C; 
col. 8, 11. 43-54). 

Therefore, it would have been obvious for one of ordinary skill in the art at the time of 
applicant's invention to supplement Van Kleeck's speech input guidance device and Au with 
White's paraphrasing of commands. The motivation for doing so would have been to allow the 
user to easily check whether the computer has the capability to recognize the context of a spoken 
command, as taught by White (col. 8, 11. 48-51). 



Application/Control Number: 1 0/078,334 Page 1 5 

Art Unit: 2626 

Allowable Subject Matter 

9. Claims 2-4 are allowable. The following is a statement of reasons for the indication of 
allowable subject matter: Claim 2 is allowable because the prior art of record does not disclose 
or suggest of a speech input guidance device wherein the number of speech inputs is coxmted and 
guidance is terminated when the count of speech inputs exceeds a predetermined number. It is 
old and well known in prior art to terminate guidance when the number of speech outputs 
exceeds a predetermined number (see e.g. Cohen). However, the prior art does not disclose or 
suggest terminating the guidance according to the counts of the speech input. Claims 3-4 depend 
from independent claim 2 and therefore are also deemed allowable. 

Conclusion 

10. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.13'6(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, vAW the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 
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1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eunice Ng whose telephone number is 571-272-2854. The 
examiner can normally be reached on Monday through Friday, 8:30 a.m. - 5:00 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on 571-272-7843. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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